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ABSTRACT 


The ability to predict Marime officer attrition 
continues to be a significant obstacle to accurate manpower 
planning at Headquarters Marine Corps. This paper expands 
on a previous study which used unemployment in a linear 
regression model to predict attrition. Through the use of a 
binary choice model, this study incorporates a number of 
additional variables, principal of which is a performance 
index score to measure promotion potential. The logit 
function was employed to evaluate the inherent causal 
relationships and to further define the ability of 
statistical analysis techniques to predict officer 


attrition. 
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Bue cS Predict Officer, 
PECrition has been In the Past ang Continues to be a Slgnif- 
lcant obstacle to accurate Promotion Planning and budget 
Preparation at Headquarters, U. <s. Marine Corps (HQMC). 
Previous Studies have attempteg to im 
running average" 


Ë better results Could be achieveg 
through Che use of additional Variables in a binary Choice 
mode1 

B, BACKGROUND 
m Historica] 
2 1 
The ability to LU Predict Office, on 
0" یت‎ to the efficient management Of the budget, Pro- 
notion boards, and recruiting requir 


uses a running average method to forecast attrition. This 
method uses the average annual attrition for the last six 
years adjusted by the intuitive assumptions of the officer 
responsible for determining the officer loss rate. This 
method is reliable only to a certain degree, with some years 
proving more accurate than others. The "off years" create 
significant complications for the efficient management of 
manpower planning. Because of this problem, HOMC requested 
a statistical study be undertaken to improve their  predict- 
ing capabilities. The request was referred to the Naval 
Postgraduate School, and Major W. J. ESMANN, USMC, conducted 
an analysis which resulted in his thesis entitled, "Marine 
Officer Attrition Model". 

Major Esmann's initlal research seemed to indicate a 
dramatic improvement in the ability to predict total attri- 
tlon, but he concluded his thesis with a recommendation that 
further research be conducted using additional variables in 
a binary choice model. 

The first problem encountered by Major Esmann was to 
narrow the choice of variables which would be used to  pre- 
dict attrition to a workable number. The initial choice of 
variables was made through interviews and the intuitive 
decisions of the officer conducting the analysis. At first, 
three categories of variables were identified as factors 
which could determine whether an officer would stay on 


active duty or leave the Marine Corps. These variables were 
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military pay, the economy (specifically unemployment), and 
promotion potential. Of these three variables, promotion 
potential was immediately eliminated because a method to 
measure that variable had not yet been developed. However, 
it is significant to note that throughout the study, those 
officers interviewed felt promotion potential would be a 
major factor in determining officer attrition. 

Next, military pay was studied using factors which 
showed its comparability with the private sector. A linear 
regression model was used to provide an insight to their 
predictive value. The results of this analysis indicated 
that comparability between military and civilian pay was not 
a Significant factor in an officer's decision to leave the 
Marine Corps. These results contradicted a study conducted 
by the Center for Naval Analysis (CNA) which showed that pay 
comparability was a factor in an officer's decision to 
remain on active duty. However, the CNA study included all 
branches of the Armed Forces while Major Esmann's model 
considered Marine officers alone. The conclusion was that a 
Marine officer was a different breed of serviceman, not 
motivated by pay when making his decision to leave the 
Marine Corps [Ref. 1]. 

Once pay comparability and promotion potential were 
eliminated, only the economy remained as a primary factor. 
To determine which aspects were significent, the possible 


economic impact on attrition was broken into three areas: 
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unemployment, consumer price index (CPI), and the Gross 
National Product (GNP). Using this economic data, initial 
testS were again run uSing a linear regression model with 
both the CPI and GNP proving insignificant as factors in 
determining officer attrition: 

Finally, unemployment was evaluated and segmented 
into professional-technical and managerial unemployment. 
These factors were assigned to groups within the data base, 
aviation officers being classified as professional-technical 
and ground officers as managerial. Again, a linear regres- 
Sion model was used to determine the significance of this 
variable. 

The data base used for Major Esmann's study was 
limited for Several reasons. First, the data included in- 
formation from the years 1976 through 1983 only. This was a 
result of the Marine Corps not being fully automated prior 
to this period. Data collected previous to 1976 was incom- 
plete and unreliable due to system complications. Second, 
actrition resulting from the Viet Nam war made it undesirab- 


le to use data from that period. 


2. Application and results 


As previously mentioned, Major Esmann's model was 
formulated to assist planners in two ways. First, it was 
designed to predict future manpower levels, an annual 


process whereby officer attrition determines accession 
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requirements and, therefore, recruiting goals. From these 
figures, the manpower budget is more accurately prepared and 
the budget call improved. Second, with a more accurate 
prediction of attrition, realistic eligibility zones can be 
determined, thus eliminating the mismatch between the number 
of vacancies and the number of officers selected for 
Promotion. 

The results of the model, using unemployment as the 
key variable, produced significant improvements over the old 
averaging method. Again, the averaging method took the sum 
of the last six years attrition, by rank, and divided it by 
Six. The value derived was then modified depending on the 
intuition of responsible officer. TABLE 1 shows the results 
of the averaging method, Major Esmann's model, the actual 
figures for FY83, and a prediction (using his model) for 
FY84. As depicted in TABLE I, a clear improvement can be 
seen over the averaging method. 

Major Esmann's study concluded that unemployment is 
a significant factor in predicting officer attrition. 
However, his concluding recommendation centered around add- 
ing a promotion potential variable to the unemployment 
Statistics in order to improve the model's’ forecasting 


ability [Ref. 2]. 
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TABLE 1 


| 
| 
| 
COMPARISON OF MODEL RESULTS | 
| 
| 
| 
١ 


| 

| 

| 

| 

١ 

| Avg Regress % Error è Error Regress 

| Rank Method Model Actual Avg Reg Model 

| 30 1988 1995 359/55 19853 1984 

| انس‎ ------— E O | 
| ١ 
| LtCol 77 152 127 39.4 1: (7 152 | 
| | 
| Major 186 149 146 27.4 21 14 | 
| | 
cape 452 377 392 1975 m e 407 | 
| | 
| lstLt 529 416 396 32006 51 425 | 
| | 


C. PLANNED IMPROVEMENTS 

With this initial background, the authors set out to 
expand the previous study and provide HQMC with an improved 
method "for predicting officer attrition. The problem of 
establishing a variable that could measure promotion poten- 
tial, one of the key factors missing from Major Esmann's 
model, was solved using fitness report data provided by 
HQMC. An explanation of this process is covered in Chapter 
II of this thesis. 

Next, a number of interviews were conducted with offic- 
ers at  HQMC responsible for predicting officer attrition. 
These interviews provided insight into the effectiveness of 
previous attempts to use Major Esmann's model. In essence, 
HOMC had achieved negative results using the Marine Officer 


Attrition Model during  FY1984 and had reverted to the 
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averaging method which was proving more accurate.  HQMC felt 
that although 1984 was not a typical year in terms of 
attrition, the averaging method provided a more accurate 
prediction than the Esmann model. These discussions gave 
some initial concerns but the authors believed the use of 
the performance index would prove to be critical factor in 
improving attrition prediction. 

In the subsequent chapters, the authors will describe 
the basic data as supplied by HQMC and the transformations 
required to create the working data base for this study; a 
description of the statistical functions available for this 
type of research, their strengths and weaknesses, and the 
eventual selection of the model that was used; the methodol- 
ogy employed during the data manipulation phase; and an 


analysis of the results with concluding comments. 
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II. DATABASE 


A. SOURCE 


The data for this thesis were obtained from the Marine 
Corps Manpower Management System (MMS) and fitness report 
input. It consisted of 132,903 records containing nineteen 
data elements on every Marine officers on active duty from 
1971 0 76 A record was created for each officer 
for each year, so that of the 132,903 records, somewhat less 
were actually in the data base due to multiple entries for 
those officers that remained on active duty during the 
period covered. A detailed example of the data supplied by 
HOMC is contained in Figure 2.1. The variables included 
were: 

(19 IDTCODES This is an encoded identification of the 
officer whose data appears on this line. 


(2) PMOS. This numeric discriptor indicates an offic- 
er's Primary Military Occupational Specialty. 


(3) FSTAMOS. This is the First Additional Military Occu- 
pational Speciality, or secondary skill the officer 
is qualified for. 


(4) ED MAJ. This a numeric designator describing the 
officer's civilian education major. 


(5) RANK. This alphanumeric variable represents the pay 
grade equivalent of the officer's rank. 


(6) ADBDY, ADBDM,  ADBDD. Combined, these variables 
indicate the Active Duty Base Date. This date is 
often not the actual date an officer first came on 
active duty, but has been adjusted for time spent 
in the reserves or as an enlisted person. 
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(7) FCOMMY, FCOMMM, FCOMMD. This is the date the offic- 
er was first commissioned. 


(8) SCORE. This is the officer's Performance Index 
Score, to be described later in this chapter. 


om) POS SCR. This is the maximum, or Possible Score, 
that an officer could have attained for his 
length of service. 
) 1 0 ( DATESEPY,  DATESEPM,  DATESEPD. This is the date 
the officer was separated from active service. 
A "." in these columns means the officer is still 
on active duty. 
NUT NSCYC YR. This is Manpower Management System date 
indicating the end of the record year this data 
was compiled from. 

The first change made to the basic data supplied was to 
eliminate those categories of officers whose presence could 
bias the results or that would have negligible impact on the 
outcome. To this end, all second lieutenants were elimin- 
ated because they would be promoted prior to reaching a 
decision point in their career. Those officers with more 
than four years of enlisted service, warrant officers, and 
limited duty officers were also eliminated because a prelim- 
inary statistical analysis indicated they tended to be ca- 
reer oriented with virtually none leaving the service prior 
to their twentieth year. The number of officers, by rank, 
remaining in the data base are displayed in Table II. 

In addition to the personal data provided through the 


MMS, data pertinent to an individual's decision to remain on 


active duty were obtained from a number of other sources. 
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Sample of the Basic Data. 
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TABLE II 


RANK REPRESENTATION IN DATA BASE 


| | 
| | 
| | 
| | 
| ١ 
| Colonel 4,072 | 
| | 
| Lieutenant Colonel 10,327 | 
| | 
| Major 20 2 | 
| | 
۱ Captain 26,750 | 
| | 
| First Lieutenant 26,250 | 
| | 
| TOTAL 87,931 ١ 
| i 


First, from the officer's fitness reports, HQMC provided 
a performance SCORE which was determined by weighting each 
of the "Performance" and "Qualities" blocks (see Figure 2.2) 
of the report and taking this value times a numeric value 
assigned to the mark received (Outstanding, Excellent, 
EROS —Thesmaximum Score assigned, or POS SCR, is the score 
that would have resulted had the officer received a mark of 
"Outstanding" in each of the observed areas. Both SCORE and 
POS SCR are cumulative, with senior officers having a higher 
value for these variables than a more junior officer. 

Second, a relationship between military and civilian 
pay, expressed as a percentage difference of the former from 
the latter, was obtained from the government's Employment 
Cost Index [Ref. 3] and added to the data base for each year 
of the period covered. The figures used in our analysis are 


displayed in Table III. 
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Figure 2.2 Example of USMC Fitness Report 
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TABLE III 


MILITARY PAY COMPARABILITY 


| | 
| ١ 
| | 
| | 
| | 
| Year Difference | 
١ | 
| 1977 -4.8 | 
| ١ 
| 1978 -4.3 | 
| | 
| 1979 -6.5 | 
| | 
| 1980 -7.3 | 
| ١ 
| 1981 -4,8 | 
| | 
| 1982 -0.4 | 
| | 
| 1983 -4.2 | 
| | 


Last, managerial and technical executive unemployment 
figures were obtained from the Bureau of Labor and Statis- 
tics. These figures (Ref. 4], which were lagged by six 
months to bring them in line with a date closer to the time 
an officer made the decision to resign, are displayed in 


TABLE IV. 


B. TRANSFORMATIONS 


Although some of the data could be used directly, many 
of the required elements needed to be derived from the basic 
data as supplied. 

An individual's Pperformance INDEX was determined by 
dividing his SCORE by his POS_SCR. Due to the inflation of 


fitness reports, the INDEX covered a very narrow range. 
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TABLE IV 


LAGGED UNEMPLOYMENT RATES 


| | 
| | 
| | 
| | 
| | 
| Year Managerial Tech. Executive | 
| | 
١ 1977 95ھ‎ 00 | 
| | 
| 1978 . 0245 . 0280 | 
| | 
| 19 . 0210 .0258 | 
| | 
| 1980 0225 . 0245 | 
| | 
| 1981 40255 0265 | 
| | 
| 1982 .35 . 395 | 
| | 
| 1983 5ء‎ .0320 | 
| | 


The inflation of fitness reports during the period 
also required the INDEX be normalized to a common mean. This 


was accomplished using the following formula: 


INDEXn = (INDEX - INDEXrm) / Std Dev 


where: 
INDEXn E Normalized Index 
INDEX = given 
INDEXrm = Index mean by rank and years of service 
Std Dev = Standard Deviation corresponding to the 


INDEXrm 


To determine if an individual's education major played a 
significant role in 1is decision to remain on active duty, 


the Marine Cors Manpow:r Management System (MMS) 
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alphanumeric code for education major was converted to a 
binary (1 and 2) choice that could be used with the  LOGIST 
procedure of SAS. This was accomplished in a somewhat 
subjective manner based on the marketability of the 
individual's level and type of degree. As an example, those 
individuals possessing degrees in the soft skills, such as 
business administration and education were given an  EDSPEC 
of 1 while those with more technical degrees such as 
computer science or electrical engineering were given an 
EDSPEC of 2. 

The variable OUT was derived from the DATESEPY element 
of the basic data. If an individual had a entry for this 
element, it indicated he had been released from active duty 
and was assigned an OUT variable value of 1. An individual 
remaining on active duty received a value of JQ. 

YEARS, or the number of years each officer had been on 
active duty, was simply his active duty base date (ADBDY) 
minus the data cycle year (CYC YR), a date used by the MMS 
to mark the annual update of individual's record. 

Because  colonels are assigned a 99XX series PMOS, or 
numerical designator for an officer's primary military occu- 
pational specialty, upon promotion, it was necessary to 
create a new variable entitled MOS that would correlate the 
actions of these officers with those of lesser grades. For 


lieutenant colonel and below, MOS equalled PMOS, but for 
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colonels, MOS equalled their first additional MOS (FSTAMOSUS 
or the MOS they had been assigned prior to promotion. 

Finally, a determination was required to accurately pre- 
sent the unemployment statistics, or the UNEMP variable. 
Like Major Esmann, the authors assigned Naval Aviators’ and 
Naval Flight Officers the unemploment figures associated 
with technical executives wnile the other officers were 
assigned the managerial statistics. This was clearly an 
Subjective de ision, but one which appeared to most correct- 
ly reflect the employability of the population. 


An example of the revised data appears in Figure 2.3. 
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Figure 2.3 Sample of the Revised Data Base 
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Ill. MODEL SELECTS 


A. GENERAL 


To assist in the analysis and prediction of Marine 
officer attrition, it was necessary to select a computer- 
assisted model that would most appropriately handle the 
unique aspects of this particular study. Previous studies 
of the subject had used multivariate regression analysis. 
Although this procedure was somewhat successful, it was 
apparent that other movels were available that might prove 
more adept at accurately predicting an officer's decision to 
remain in the Marine Corps or leave the service. Therefore, 
following the collection and refinement of the data base, a 
thorough analysis of the available models was conducted to 
determine the algorithm that would most accurately predict 
the binary “stay / leave" decision. 

1. Linear 6 )+ ٢ 01 

Linear multiple regression analysis is probably the 
most commonly used tool of the statistician who wishes to 
develop a model that will predict a dependent output from a 
Series of known, independent inputs. This form of regres- 
sion analysis is concerned with modeling the relationship 
among the independent variables. It quantifies how a 
response, the dependent variable, is related to a set of 
explanatory, independent variables. If the true relation- 


ship among the variables were known precisely, the 
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statistician would be able to accurately predict the 
outcome. However, the true relationship is rarely known and 
approximations must be developed from empirical evidence. 

To accomplish this approximation, the concept of 
least squares is used to fit the regression equation to the 
observed data. The least squares method requires that a 
line be chosen to fit the data so that the sum of the 
squares of the vertical deviations separating the points 
from the line will be a minimum. These deviations are 
represented by the lengths of the vertical line segments 
that connect the points to the estimated regression line. 
In the case of multiple regression, the line is replaced by 
a hyperplane with dimensions equal to the number of 
independent variables. The resulting estimated multiple 


regression equation would be: 


a DOTA TT D A e ee t D Xant e 
where: 

The value of Y calculated from the‏ دم 
regression equation.‏ 

a = The value of the constant or "y- 
intercept". 

b, = The estimated regression coefficient of 
a particular independent variable. 

Xp = An independent variable. 

e = Residual error associated with the model 
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As can be seen, the major goal of linear ۶٦ 
regression is to predict Y from the regression plane for 
given levels of X. This is an excellent tool, with some 
reservations, if the independent variables are continuous 
and randomly distributed (weight, speed, or payload) and 
the independent variable will also be continuous, Such as 
cost [Ref. 5]. But, if the investigator wishes to predict 
the either/or behavior of an individual or group based on 
the observed past performance of a similar group, then the 
traditional forms of regression analysis are not able to 
accurately predict their response or action because the 
independent variable is qualitative, or at least observed to 
be qualitative, and not quantitative. Voting, the decision 
to marry, have children, or go to college are examples of 
qualitative decisions that are not adequately handled by 
linear multiple regression. What is needed, therefore, is a 
Set of statistical techniques that can do the work of multi- 
ple regression but with qualitative choices as the indepen- 
dent variables. Following will be a discussion of two of the 
more commonly used procedures to accomplish this task. 

2. Discriminant Analysis 
Discriminant Analysis deals with a specific class of 
Statistical problem that focuses on the study of groups of 
populations or data sets. In general it is assumed that the 
groups being analyzed are discrete and identifiable, that 


each observation in the group can be described by a set of 


28 


measurable variables, and that the variables have a normal 
distribution within each group. With this in mind, the 
purpose of discriminant analysis is to test for mean group 
differences and to describe the overlaps among the groups 
(the decision to leave the Marine Corps for instance, is a 
different one than the decision to stay so that the 
probabilities may add to more than one due to this overlap). 
Furthermore, discriminant analysis will construct a classi- 
fication scheme based on the variable set and thereby create 
a predictive model with which to determine the probable 
actions of similar groups. 


To use discriminant analysis as a predictive tool, a 


concept similar to regression analysis called the 
discriminant function is employed. However, unlike the 
linear regression problem, the dependent variable is 
dichotomous. This function uses a weighted combination of 


the independent variables to classify a response into a 
variable group. Furthermore, using a weighted sum of values 
derived from the individual predictor variables, a 
discriminant score is calculated. A cutoff score is then 
determined that, used in conjunction with the discriminant 
Score, assigns those observations with discriminant scores 
higher than the cutoff score to one of the criterion groups 
while those observations with discriminant scores less than 
the cutoff are assigned to the other [Ref. 6]. The 


discriminant function is expressed as follows: 
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Discriminant score 


o 
3 
li 


Weights associated with the predictors 


X,= Values of the predictor variables 


The default cutoff score in most automated systems, such as 
SAS or SPSS, is .5 with the user being able to modify the 
breakpoint, if desired, to weight the outcome. This would 
be done to reduce the number of misclassifications in a 
particular direction. 

In general, discriminant analysis allows the 
Statistician to classify objects into groups based on their 
values as predictor variables and, much like multiple 
regression, creates a model that can predict individual or 
group behavior based on the actions of a similar population 
base from the past. One of the key factors in accurately 
predicting behavior, however, is that there be a large 
difference between the criterion groups. This was certainly 
not the case with one of the primary variables used in the 
study of Marine officer prediction, namely the performance 
INDEX. Due to the inflation of the fitness report marks 
during the period covered by the data base, it was found 
that the vast majority of the INDEX values fell into a very 
narrow range. Thus the difference between an outstanding 
officer and a less capable one was numerically very small. 


This led to classification errors and therefore less than 
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acceptable results when trying to determine what percentage 
of a particular group would leave the Marine Corps. 
3. Logit 

Logit iS a binary-choice model that assumes that 
individuals faced with a choice between two alternatives 
will make a decision based on their respective  characteris- 
tics. Unlike discriminant analysis, which postulates that 
the observed values of individual characteristics and 
attributes of alternatives are drawings from posterior  dis- 
tributions conditioned on actual responses,  logit proposes 
that the actual responses are drawings from multinomial 
distributions with selection probabilities conditioned on 
the observed values of individual characteristics and attri- 
butes of alternatives. With this in mind, it can be seen 
that the logit model can be used to calculate the probabili- 
ty of an individual making a particular choice, such as to 
get out of the Marine Corps, conditioned on an observation 
of some specific elements of information about that particu- 
lar officer. To accomplish that process, the function takes 


the general form: 


Fj 
Zi = Log ( DOMI سر وره کک‎ ) = b, Xj st: b, TT + eee b. Xij T e 
l EE P; 
where: 
Z, = Probability that a particular decision will be 
made given a particular variable grouping 
P; = Probability that an individual will make a 


E 


? varj bl 
Xj = aridi Ch that ۱ ^J, et repres 
enting th t; 2nd an ariab] nd 
07" bei 9 the Jth obs vation a وف‎ m 
Variab1 
SL Oeffic nt “ssoci with each *ndependent 
Variab1 


To aSSist in the “*Planation of this Process, the 
following example Of t 


Name Sex Income Status P 
A M H I «62 
B M M I . 47 
E F M I . 69 
X M L O «47 
Y M L T . 53 
Z M H O «38 

P = Th Centag the data base havi g POLT 

Prof °MPareg Co th tota] n ۳ he in epen- 
qent ç la group, exam ; Tales (wj high (gj 
income at sta ed In (I) lvid les With h 
incom 
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Z = Male, high 

Z, = Male, medium 

Z, = Male, low 

Z, = Female, high 

Z, = Female, medium 

Z¿ = Female, low 
Once these probabilities have been calculated in conjunction 
with a particular choice, for instance to get out, the model 
is run against the population to be tested and the individ- 
ual probabilities summed to determine the number predicted 
to leave the Marine Corps. For example, using the following 


test data, 1 


TEST DATA 
Obs Sex Income Z 


. 34 
. 69 
2 
223 
23 
+38 
25:39 


سم لنم نا ظ ی O‏ 
rn rs =‏ = = = 
x‏ <= ده چا 


the logit function predicted that 2.39 officers would be 
leaving the Marine Corps. 

Since the logit function makes far fewer assumptions 
than the discriminant model, such as no multivariate 
normality for covariates, this form of regression analysis 
is often preferred to discriminant analysis. In addition, 


the theory that an officer would leave the Marine Corps 
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because of pay di erences, his educational background, or 
perceived  probab..ity of promotion suggests a causal rela- 
tionship between the explanatory variables and the probabil- 
ity of his separation. Here again, in side-by-side 
comparisons, the logit function has proved to be somewhat 
more accurate in forecasting the direction the dependent 


variable will take [Ref. 7]. 


B. MODEL SELECTION 


Based on the foregoing analysis, and the availability of 
the appropriate models at the Naval Postgraduate School, the 
authors elected to use the logit function to conduct this 
study. AS implemented by the Statistical Analysis System 
(SAS), the logit function 1< ء٦4‎ 7 Supporting 
the basic program are a number of standard statistical tools 
to assist the user in the sterwise elimination of insignifi- 
cant variables. As a guide to the reader in evaluating the 
SAS LOGIST output, a sample printout is included in Figures 
3.1 - 3.4, with the critical points explained below. 

l. This matrix depicts the percentile distribution of a 
particular group based on their individual 
performance INDEX. This matrix, although not part 
of the LOGIST procedure, was included to assist in 
the analysis by displaying the number of officers 
falling into each of the ten categories. This 
breakout by INDEX gives tbe investigator a detailed 
view of why the model is, or is not, performing as 
expected. In this example, there is a wide differ- 
ence between those staying in (the column headed 


"9") and those leaving (the column headed  "1"). 
Although this difference slowly fades as the INDEX 
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scores increase, this model should perform very well 
in predicting officer attrition because of the dis- 
tinct classification process that has occured. 


2. This is the number of observations in the group con- 
sidered, less those with missing data. 


3. Displayed in this area is the basic statistical data 
on the independent variables. 


4. The P-value for testing the joint association of 
all variables in the model with the dependent 
variable is displayed at this point. In this 
example, the P-value of Ø indicates the model is 
totally significant. 


5. These are the P-values of the individual variables 
deleted from the model as insignificant. 


6. Displayed here are the estimated regression coeffi- 
cients for each variable in the model. 


7. This column contains the estimated standard errors 
of the regression coefficient estimates. 


8. This column contains the P-value of the variables 
retained by the model as being significant. 


9. “This column depicts the lower confidence limit of 
the predicted probability. 


10. Displayed in this column is the predicted probabil- 
ity of this particular officer leaving the Marine 
Corps given the values of the independent vari- 
ables associated with this observation. 


ll. This column contains the upper confidence limit 
of the predicted probability. 


12. This is the summation of the predicted probabilities 
for this group, which equals the total number of 
officers the model predicts will be getting out of 
the Marine Corps [Ref. 8]. 

This concludes a description of the model selection 
procedures. In Chapter IV, the authors will analyze the 


output resulting from the application of the logit model to 


each of the groups studied. 
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Sample SAS Output 


Figure 3.1 
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Figure 3.4 Sample SAS Output 
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IV. ANALYSIS 


A. GENERAL 


The initial step of the aralysis was to perform a 
preliminary study of the basic data. Through this review, 
the authors selected and, if necessary, transformed the 
independent variables which they felt would prove useful in 
predicting attrition. Along with this procedure, the 
dependent variables were transformed from the basic data to 
reflect a binary choice decision. With this accomplished, 
the basic data were purged to eliminate biased information. 
Through these procedures, a data base was created from which 
eight population groups were selected and evaluated using 


the SAS LOGIST procedure. 


B. INDEPENDENT VARIABLES 


As indicated in Chapter III, manipulation of the data 
was required to create a file which would contain the 
Significant factors to conduct the analysis. Once the data 
base was transformed into a workable file, the independent 
variables to be used in the study were selected on the basis 


of intuitive decisions by the authors. 


The first variable selected was INDEX. This variable 
was the primary reason for conducting this’ follow-on 
analysis of officer attrition.: However, the binary choice 


model enabled the authors to add additional independent 
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Could only Strengthen the binary Choice model, While 
dnemployment WaS the only Strong Predictor in the Esmann 
Study, it was Delieveg that one other Variable, PAY 
06 might Prove تچ‎ e when سب‎ with 
INDEX and JNEMPloymen,. 

Along Wlth Performance index, “nemployment (both 


managerial and technical), and pay 0+800 two 


k dictin Officer Sele on First, educatio, major was 
Selected because Of itg ability to determina the 
ہی رف6‎ Of an individual in the Civilian Sector. 
The authors felt that those Officers VIED wa technica] 
backgroung Would have a better oPPortunity for gaining 
Outsiqe employment while those with BEES 
backgrounds would Seek the OEIL Of the Service. Initia] 
| C eptions were that this Variable would Prove 0 


only tO the junior Officers on their initial Service 


indication of his career potential in the arm s es 
Those officers with a PMOS of 0302 (infantry) and 0892 
(artillery) would seem to be taking the "ideal" career path 
of a Marine ground officer. Both authors have observed that 
officers without the above specialties did perceive 
themselves to be less promotable and therefore more likely 


to attrit when the opportunity arose. 


C. DEPENDENT VARIABLE 


The dependent variable for this model was entitled 
TOUTES This variable positioned a 1 in every record which 
had a separation date and a Y in those records for which 


there was no separation date. 


D. SCORE UE STUD 


1. General 

In order to remove data that would bias the outcome 
and to limit the scope of the study to a reasonable number 
of population groups, cwo decisions were required prior to 
the application of the logit function to the data. First, 
it was determined that a large portion of the population, 
for which the decision to attrit was either insignificant or 
not a factor at all, would have to be eliminated from the 
data base. Second, once this group was deleted from the 
data, a decision was required to determine which of the many 


possible rank by years-of-service population groups could be 
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analyzed in the time allotted and still provide a accurate 
projection of officer attrition. 
2. Biased Data Elimination 

In keeping with the Esmann study, the authors 
eliminated all ground second lieutenants from the analysis 
because their initlal contracts would require them to remain 
on active duty until after they would have been promoted to 
first lieutenant. By the same criterion, aviators were also 
not evaluated until they had reached the rank of captain. 

Additionally, the authors eliminated all limited 
duty officers and warrant officers. As explained in Chapter 
II, these officers have normally  amassed tenure from prior 
enlisted service and their committment to remain on active 
duty is strengthened by their selection for promotion to 
officer status. 

3. Model Population Groups 

The initial intention was to run the independent 
variables against the dependent variable "OUT" by rank. 
However, further study clearly showed that to run this model 
against a population categorized by rank only would give a 
very biased result. A captain with 6 years of service faced 
with the decision to leave the Marine Corps is influenced 
by different factors than a captain with 9 years of service. 
AS discussed in Chapter II, the variable YEARS was created 
from the basic data by subtracting an individual's active 


duty base date (ADBDY) from the data cycle year (CYC YR). 
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Through this transformation, the variable YEARS provided the 
authors with the ability to further separate the RANK 
populations by the number of years an officer had been on 
active duty. This procedure greatly expanded the number of 
population groups which could be evaluated. To reduce the 
complexity of this problem, a program was written to show 
the frequency of attrition by year and rank. These data 
proved useful in evaluating the final results, as well as 
indicating which years by rank were the critical years for 
attrition. 

The authors, using the results of this analysis, 
determined that a satisfactory evaluation of Marine officer 
attrition could be accomplished by studying five years by 
rank groupings. The significant year is that point in an 
officer's career when the greatest number of his peers leave 
the Marine Corps. As shown in Table V, the significant 
years for each rank were: First lieutenants, year 3; 
captains, year 5; majors, year 11; lieutenant colonels, year 
26; colonels, year 26. Also depicted in Table V are the 
actual attrition figures for FY 81, the year 17 لر‎ 
establish the validity of the LOGIST model. 

Once this decision was reached, the only remaining 


factor was to determine whether ground and aviation officers 


should be separated and tested independently. The decision 
was, like the Esmann model, to test these groups 
independently. The authors realized that the aviation and 
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ground Communities Were a different breed, Separateg not 


Summarizing, Table VI Shows the Population groups 


that Were evaluated along With the Independent Variables 


ee ۹ لاد‎ 


| Data Significant Years ١ 
| Group 3 0 26 | 
| E 183 E = - = | 
Capt - 118 = = = | 
| Maj = = 4 - - | 
Lt Co] - - - 47 = 
| Col - - - - l6 | 


ie. “ 


As indicateg above, a different Variable Set was UCllizeg 


managerial unemployment rate. On the Other hand, aviators 


TABLE VI 


GROUP/VARIABLE CORRELATION 


| | 
| | 
| | 
| | 
| | 
| Data Group Variables Used | 
! 
| 1st Lt (Gnd) INDEX, PAY, UNEMP (Mgr) | 
| MOS, EDSPEC | 
| | 
| Capt (Gnd) same as lst Lt (Gnd) | 
| | 
| Capt (Air) INDEX, PAY, UNEMP(Tech) | 
| EDSPEC | 
| | 
Maj (Gnd) Same as Capt (Gnd) | 
| | 
| Maj (Air) Same as Capt (Air) | 
| | 
| Lt Col (Gnd) Same as Capt (Gnd) | 
| | 
| Lt Col Ka) same as Capt (Air) | 
| | 
| Col INDEX, PAY, UNEMP (Mgr) | 
| EDSPEC | 
| | 


(Infantry and Artillery) and the remainder of the 
population. For colonels, the authors eliminated any MOS 
distinction because these officers have made a critical 
transition to an executive level where MOS looses its 
Significance. Because the aviation population groups were 
tested independent of the ground officers, MOS was not a 


factor and therefore eliminated. 


8 7٣۲ 
1. General 
Once the data groups were established, the authors, 


using the LOGIST procedure, analyzed the data groups in two 
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areas. First, the authors fit the models to the FY77 
through ٧۷8٥ data using the LOGIST function. This was 
accomplished by the LOGIST procedure, using the stepwise 
mode, which provided statistical data on those variables 
remaining in the model as well as those deleted because they 
failed at the .05 level. The estimated models resulting 
from this procedure provided the output that was then used 
to produce a probability, or P-value, for each individual to 
be tested in the FY81 and FY82 forecast years. The 
summation of these individual probabilities gave the 
predicted attrition for the population group being analyzed. 
Comparing the predicted number with the actual figures 
provided by HOMC, the authors were able to calculate a 
prediction rate for each population group. For consistency, 
this prediction rate was calculated as an absolute value, 
always using the lower of the two numbers (actual or 
predicted) as the numerator. 

Because the primary purpose of this analysis was to 
evaluate the predictive capabilities of the logit model of 
Marine officer attrition, prediction rates are presented 
First, Then the significance of the variables in the 
estimated models are discussed. To assist the reader, the 
authors have included in the dis-ussion that follows for 
each population group, a table ranking the variables in 
order of significance by P-value of their associated Chi 


Square tests. In addition, uSing a procedure unrelated to 
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LOGIST, interval tables displaying the performance s 
percentile were addressed. 
2. First Lieutenants (Ground) 
a. Prediction Rates 
Prediction rates for this group showed varying 
results. For FY81 actual attrition for ground officers in 
this data group was 183. LOGIST predicted a total of 186 
officers would attrit during FY81 for a prediction rate of 
98 percent. Encouraged by these results the authors decided 
to evaluate FY82 for a more c-aclusive study. For FY82 
the results of the model were far less accurate. Actual 
attrition for FY82 was 169 while LOGIST provided a forecast 
of 140. These figures equated to an 83 percent prediction 
rate or far below the rate achieved with the FY81 model. 
Figure 4.1 displays 43 observations from the FY81 data 
group, along with the predicted probability (column P) of 
each officer leaving the Marine Corps. Below the 
observations, in the "SUM" column, is a summation of the 
predicted probabilities, or the total number LOGIST predicts 
will leave the Marine Corps in FY81 and FY82 
b. Significance of Variables 
All variables within this population group 
proved significant at the .05 level. Performance INDEX 
showed the lowest P-value indicating its high level of 
Significance to the model while PAY was the least 


significant with a P-value closest to .05. Table VII 
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Figure 4.1 First Lieutenants (Ground) 
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shows, by their order of significance, each variable and 
their corresponding P-value and the Chi Square statistic. 


Figure 4.2 shows the final parameter estimates 


of each variable with its associated P = statistic and 
regression coefficients of each of the Significant 
varlables. These results would seem to indicate that the 


junior officer is most concerned with his level of success 
during his initial military contract agreement. Yet 
another, probably more important factor, is the officer's 
realization that the Marine Corps is not what he expected. 
This happens quite early in a young officer's career and 
his performance and attitude drop off quickly relative to 
that of his peers. This difference in outlook, and 
therefore performance, is reflected in the officer's INDEX 
TABLE VII 


VARIABLE SIGNIFICANCE, FIRST LIEUTENANTS 


| | 
| | 
| | 
| | 
| | 
| Variable P - Value Chi - Square | 
| | 
| INDEX š 241.65 | 
| | 
| UNEMP 0.0000 28.49 | 
| | 
| EDSPEC 0.0001 16.14 | 
| | 
| MOS 0.03109 4.65 | 
| | 
| PAY 0.0423 4.12 | 
| | 


score and a clear distinction is made between the two 


groups. Because only those officers with the higher scores 
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LIEUTENANT (GND) 
STEPWISE LOGIST IC REGRESS IUN PROCEDUKE 


OEPENDENT VARIABLE: OUT 

4108 OBSERVATIONS 

3179 UUT = U 

929 OUT = 1 

1052 CBSERVATIONS DELETED DUE TO MISSING VALUES 
VARIABLE MEAN MINIMUM MAX 1 MU M 
INDXN 0.881927 0,325017 1 0.6 
PAY -5.88715 7 3 -4.5 
UHEMP 0 ۰0۵ 30 6 33 0.021 0.0295 0 
ED SPEC 1.15207 1 2 
MOS 1.3313 1 2 


-2 LU; LIKELIHUOD FOR MODEL CONTAINING INTERCEPT ONLYs 4392. 


SIP 0. THE FOLLOWING VARIABLES ARE ENTERED: 
INITERCLP INUXA PAY UNEMP EUSPEC MOS 
MODEL ¿HI-SQUARE= 335.68 WITH 5 D.F. ISCORE STAT.) P=0.0 
CCHVERSENCE OBTAINED IN 5 ITERATIONS. R= 0. 
MAX ABSCLUTE DERIVATIVE=0.9B76D-07. -2 LOG L= 407^ 
MOUEL CHI-SQUARE= 317.76 WITH 5 D.F. I-2 LOG L.R.) P=0.0 
FRACTION UF CJNCURVANI PAIRS OF PREDICTED PROBABILITIES AND RESPONSE 
RANK CORRELATION BETWEEN PREDICTED PROBABILITY ANO RESPONSE 
FINAL PARAMETER ESTIMATES 
VARIABLE BETA و‎ ۵ ٤٢٢ CHI-SQUARE P 
INTERCEPT 10.05289643 0 «86809910 134.11 : 
[NU XN -9.20897329 0.5924 0968 2591.05 ° 
PAY 0 0 5 0.04702005 4.12 0.3423 
UNE MP -99.43144785 18.620322 T4 209239 0.0000 
EDSPEC -0.487155712 0612139434 16.14 0.0001 
MOS 0.17945947 0.033197 32 4.65 0.0310 
CLASSIFICATION TABLE 
PREDICTED 
NEGATIVE POSITIVE TUTAL 
7 NEGATIVE 3131 43 3179 
POSITIVE 821 108 929 
TCTAL 3952 ۱ 156 4103 
SENSITIVITY: 11.62 SPECIFICITY: 98.52 CORRECT: 73.8% 
FALSE POSITIVE RATE: 30.3% FALSE NEGATIVE RATE: 20.82 
FRACTIUN UF CINCURDANT PAIRS OF PREDICTE.) PRUBABILITIES AND RESPONSE 
RANK CURRELATION BETWEEN PREDICTED PROBAJILITY ANO RESPONSE 
Figure 4.2 First Lieutenants (Ground 
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continue to make the Marine Corps their career, the 
distinction between those with the greater promotion 
potential and those who will fail selection or get out is 
much less later in their careers. Since the dependent 
variable is the probability of separating from active 
Service, one would expect a negative relationship between 
the INDEX score and the dependent variable. This negative 
coefficient clearly indicates a strong negative correlation 
between a higher INDEX score and an officer's decision to 
leave active duty. 

Following INDEX is the UNEMPloyment variable. 
This would seem to indicate that many of these young 
officers initially made the military their choice of 
employment because of the high unemployment rates they faced 
upon graduation from college. Three years later, these same 
officers, faced with a similar decision, opt for the 
security of a military career, making t e high umemployment 
rate more profound. Supporting this view is the negative 
coefficient associated with the  UNEMPloyment variable, 
which indicates that as the unemployment rate increases, 
the probability that an officer will leave active duty 
decreases. 

The educational background of this data group 
also proved to be highly significant. Again, since the 
dependent variable is the probability of separating from the 


Marine Corps and a higher education level would seem to 


5 


indicate increased employability, the expected sign of this 
coefficient would be positive. However, in this case the 
negative coefficient assigned to the EDSPEC variable 
indicates that those officers with the more technical, and 
therefore more saleable, degrees are remaining in the Marine 
Corps. 

The remaining variables, MOS and PAY, were less 
significant than the above variables but not enough to be 
deleted from the model. While MOS and PAY are factors in 
this model it is understandable why they are less 
significant. In the case of MOS, the junior officer is at a 
point in his career that the significance of a combat arms 
MOS has little effect on his outlook regarding career 
aspirations in the Marine Corps. If it has, the officer is 
Still at a point in his career to allow him the flexiblity 
to change his MOS to one of the combat arms. Nevertheless, 
the positive coefficient associated with this variable 


indicates, as expected, that those officers with the combat 


arms MOS's are remaining in the Corps. The least 
significant of all of the variables was PAY. Interestingly 
enough, the positive coefficient associated with this 


variable indicates that as pay becomes less comparable with 
the private sector, attrition decreases. This apparent 
anomaly 1S unexplained. Officers in this data group, for 
the most part, are experiencing their first full-time job. 


The military offers these junior officers a comparable 
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salary to their peers in the civilian sector and therefore 
they perceive their pay to be adequate. 
C. Performance Index Interval Table 

Figure 4.3 shows ten equal sub-group intervals 
within the first lieutenant population group. These  sub- 
groups show actual attrition rates for each index interval 
during the period FY77 through FY80. For this data group 
only one interval shows an "out" (1) percentage which is 
greater than the "in" (0) percentage. This is interval l, 
or all those officers with a performance index less than or 
equal to .796879. At the other end of the scale these 
percentages change, showing that officers with the higher 
index have the greatest retention rates. This table clearly 
indicates that for this data group, the Marine Corps is 
retaining those officers with the higher performance index 
while those at the extreme bottom are attriting at a 
significant rate. 

3. Captains (Ground) 
a. Prediction Rates 

Like the previous data group, the prediction 
rate for captains in the ground community for FY81 was 
extremely high. Actual attrition for FY81 was 51 officers 
while  LOGIST predicted 58 officers would attrit for a 98 
percent prediction rate. As with the previous data group, 
the model was also evaluated with FY82 data in order to 


confirm. its validity. The FY82 results were far less 
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encouraging than those for FY81. Attrition during FY82 was 
43 officers while  LOGIST forecasted that 32 officers would 
leave the Corps. This equated to a 74 percent prediction 
rate. Figure 4.4 shows the results of this analysis. 
b. Significance of Variables 

With this particular data group, only two 
variables remain in the model at the .05 significance level. 
As discussed below, these variables, INDEX and EDSPEC, play 
a significant role in an officer's decision to attrit from 
the Marine Corps. Here again, the negative coefficient 
associated with the INDEX variable indicates that officers 
with higher performance index scores are much more likely to 
remain on active duty. The remaining variables used (PAY, 
UNEMPloyment, and MOS) were deleted from the model because 
they proved to be insignificant at the .05 level. Table 
VIII shows the variables used to predict attrition in this 
group ranked from those proving to be the most significant 
to those having no impact on the model's ability to predict. 

The final parameter estimates along with the 
variables deleted from the model are shown in Figure 4.5. 
As in the previous data group, INDEX is again the most 
Significant variable. The output from these two data 
groups would seem to indicate that an officer's performance 
level plays a major role in his decision to either leave or 
Stay in the Marine Corps. The other variable in the model, 


EDSPEC, may remain a factor because these officers, with 
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Figure 4.4 Captains (Ground) 
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Figure 4.5 Captains (Ground) 


58 


ii ccc ccc ccm ec cc ec س‎ 


TABLE VIII 


VARIABLE SIGNIFICANCE, CAPTAINS (GND) 


í | 
| | 
| | 
| | 
| | 
| Varlable P — Value Chi - Square | 
| | 
| INDEX 0.0009 26.14 | 
| | 
| EDSPEC 0.0000 231/1 | 
| | 
| MOS 0.90720 6.27 | 
| | 
| UNEMP 0.60 3.04 | 
| | 
| PAY ۱ 0.36 | 
| ١ 


five years of service, are very employable in the civilian 
market based on their educational background and job 
experience. Supporting this idea is the positive 
coefficient for the EDSPEC variable. Unlike the first 
lieutenant population group, this positive relationship 
indicates that those officers with the more technical 
educations have a higher probability of leaving the service. 

A number of variables were deleted from the 
model. MOS and PAY may have proved insignificant for the 
Same reasons they were less than totally significant in the 
previous data group. The deletion of the UNEMPloyment 
variable may explain the reason EDSPEC becomes significant 
to the model. A technical education, along with five years 
of experience as a military manager, may make civilian 
employment more available for this group than the national 


unemployment rate indicates. 
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c. Per ormance Index Interval Table 

The table again shows the highest attrition 
rate occuring at interval 1, or those officers having a 
performance index less than or equal to .8430951. Indicated 
is that out of lll officers in this sub-group, 40 have left 
the service for a 36 percent attrition rate. The remaining 
intervals are generally within the same range with interval 
2 showing an "in" rate of 87.5 percent with a 12.5 percent 
"out" rate and interval 10 having an 88 percent "in" rate 
with an 11.9 percent Touti irate: This table clearly shows 
that those officers with the lowest performance index, 
interval l, attrit at the greatest rate. Figure 4.6 shows 
the interval table with corresponding attrition rates. 

4. Captains (Air) 
a. Prediction Rates 

Unlike the previous data groups analyzed, LOGIST 
was unsuccessful in predicting attrition for both FY81 and 
O2 Actual attrition for FY8l was 67 officers. The 
LOGIST sum predicted 29 officers would attrit for a 43 
percent prediction rate. For FY82 the actual attrition was 
26 officers while LOGIST forecasted 6 officers would attrit 
for a 23 percent prediction rate. Figure 4.7 depicts the 
predicted attrition rates provided by LOGIST. The reasons 
for the model's poor performance are discussed following 


Table IX. 
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b. Significance of Variables 
In the case of captains (Air), all variables 
remain in the model with INDEX again proving the most 
Significant. The variables are shown in Table IX with the 
P-value and the associated Chi Squares. 
TABLE IX 


VARIABLE SIGNIFICANCE, CAPTAINS (AIR) 


Variable P - Value Chi - Square 
PAY 0.0016 10.01 
UNEMP 0.0054 7.74 
EDSPEC 0.0315 4.62 


| 
| 
| 
| 
| 
| 
| 
INDEX 0.0000 26.14 | 
| 
| 
| 
| 
| 
| 
| 


Figure 4.8 shows the variables and pertinent 
Statistics provided through the LOGIST procedure. While the 
LOGIST model proved unsuccessful in predicting attrition for 
this group, an analysis of the variables may give some 
insight as to its failure. Like the ground community, the 
aviation element places a high level of significance on 
performance. However, PAY becomes more significant within 
this population group. This is reflected by the negative 
coefficient associated with the PAY variable which shows a 
direct connection between higher military pay and retention. 
This may explain the need of the Marine Corps to pay bonus 


dollars in order to retain these officers. The UNEMPloyment 
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Figure 4.8 


variable remains significant while the variable closest to 
.05 is EDSPEC. Although EDSPEC remains in the model, it has 
the least significance compared to the captain (Ground) 
mode1. This may be the result of all of the officers in 
this group having a technical education. One interesting 
observation is that in this population group, all variables 
remain in the model. Similar results were achieved within 
the first lieutenant model. Both models show officers 
making a decision on whether to remain in the service after 
their initial contract obligation. 
C. Performance Index Interval Table 
Figure 4.9 shows the interval table with the 

corresponding percentages. This interval table, like the 
ones that precede it, indicates that attrition is greatest 
in the first interval. Interval 1, depicting those officers 
with an INDEX score less than or equal to .840127, shows a 
53 percent attrition rate in this population sub-group. 
While attrition is greatest at interval l, the next three 
intervals also show a significant attrition rate when 
compared with the remaining intervals in the table. The 
combined attrition rate for these three intervals is 31 
percent. Again, this table shows attrition is greatest for 
those with the lower performance index scores. 
5. Majors (Air and Ground) 

Although the LOGIST procedure was utilized to analyze 


these two data groups, the attrition rates were too small to 
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provide a worthwhile analysis. Actual attrition for FY81 
for both the air and ground communities was four officers! 
During FY82 a total of five officers within these data 
groups left the Marine Corps. A review of majors mith 11 
years of service showed similar attrition rates from  FY77 
through FY83. With this level of attrition, the authors 
believed a worthwhile analysis of the data was impossible 
and discontinued any further study of this group. 
6. Lieutenant Colonels (Ground) 
a. Prediction Rates 

The LOGIST procedure provided poor FY81 and FY82 

prediction rates for this data group. For FY81, actual 


attrition was 34 Marine officers while LOGIST predicted 45 


officers would leave ‘he Marine Corps, or a 76 percent 
prediction rate. The results for FY82 were even less 
promising. Actual attrition was 15 officers compared to a 


LOGIST preciction of 44, or a 34 percent prediction rate. 
Figure 4.10 shows the results of this model for both FY8l 
and FY82. 

b. Significance of Variables 


Figure 4.11 shows the final parameter estimates 


for this model. This data group retained two variables in 
the construction of the model. As with all of the other 
data groups studied, INDEX was the most significant. The 


other variable retained in the model was MOS, continuing the 


trend (discussed below) that in the ground community at 
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LIEUTENANT COLUNEL (GNO) FY81 PREDICTION RATE RESULTS 
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LT CULS (SND) WITH 20 YEARS 
STEPMISE LUGISTIC REGRESSION PHUCEDUKE 


DEPENOENT VARIADLE: OUT 


6+9 CBSERVATIONS 

463 UUT = Ü 

135 OUT = 1 ۱ 

157 OBSERVATIONS OELETEO QUE TO MISSING VALUES 
VARTABLE MEAN MININUM MAXIMUM RANGE 
INOXN 0.884749 0.789441 0.983742 0.194301 
PAY -577731 -7 3 -4.5 2.3 
UNEMP 0.0244 309 0.021 0.0295 0.0085 
EUSPEC 1.16321 1 2 1 
MOS 1.60494 1 2 1 


-2 LO; LIKELIHOCO FOR MUDEL CUNTAINING INTERCEPT ONLY= 775.10 
SIP O. [ME FOLLUWING VARIABLES ARE ENTERED: 


INTERCEP INDXN PAY UNEMP EOSPEC MOS 

CUNVERGENCE OUTAINEO IN 5 ITERATIDONS. R= 0.229T. 

MAX ABSOLUTE DERIVATIVE=0U.79UC1U-U6. -2 LOG L= 696.74. 

MUDEL  ¿HI-S JUARE= 78.36 WITH 5 Oef « {-2 LUG Left.) P=0.0 ° 
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DELETL O CHI-SGUARE P CHI-SQJARC D.F. P 
LDSPEL 0.03 Q, 8€T^ 0.03 1 0.867^ 
PAY 3.05 0.0803 3.03 2 0.2148 
STEP Ts 
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FRACTION CF CNCURDANT PAIKS OF PREOICT=9 PROBABILITIES ANU NESPONSES :0.698 
RAIK CURRELATICN BETWEEN PREVICTED FROBACLILITY AND RESPONSE 70.413 

TEST FOR ALL VARIABLES NUT IN THE M 
RESIDUAL CHI-5QUARE= 6.99 diTli D.F. P=).0723 


RES [DUAL CHI-SQUARE IS NCT SIGNIFICANT AT THE 0.0500 LEVEL. 
LT COLS IGNU) WITH 20 YEARS 


DEPENDENT VARIABLE: CUT 


FINAL PARAMETER ESTIMATES 
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Figure 4.11 Lieutenant Colonels (Ground) 
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least, having a combat arms MOS is perceived to be important 
to an officer's future in the Marine Corps. Variables 
deleted from the model were UNEMP, PAY and EDSPEC. Table x 
shows the variables for this data group. 

While INDEX remained the most significant 
variable throughout this study, the positive coefficient 
assigned to INDEX shows a distinct break from the preceding 

TABLE X 


VARIABLE SIGNIFICANCE, LIEUTENANT COLONELS (GND) 


| ۱ 
۱ ۱ 
| | 
| | 
| ۱ 
۱ Variable P - Value Chi - Square | 
| ۱ 
| INDEX 0.1300 47.12 ١ 
| | 
| MOS 0.0000 25241 ۱ 
| ۱ 
۱ UNEMP 0.0500 3.84 ۱ 
| ۱ 
| PAY 0.0898 3.05 | 
| | 
| EDSPEC 0.8678 0.03 | 
| | 
population groups. This indicates, for the first time in 


this study, that those officers with the higher performance 
index scores have a greater probability of attrition. This 
output supports the data displayed in the Performance Index 
Interval Table discussed below. Additionally this data 
group placed a high level of significance con MOS. This 
would seem to indicate that after reaching the rank of 
lieutenant colonel, officers begin to regard their job 


assignments as a means of enhancing their future chances for 
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promotion. Marine officers in this data group with combat 
arms MOS's have had more command assignments, making their 
future promotion potential greater than those who have never 
served in this type of job due to their restrictive MOS's. 

Addressing the variables deleted,  EDSPEC seems 
to become less significant as the officer moves further away 
from his undergraduate years. This supports the  authors' 
original impressions about this variable, believing it would 
prove significant only for the younger officers. PAY was 
also deleted. This is because these officers have spent 
twenty years in the military, and any real concerns with pay 
would have forced them to attrit at an earlier stage in 
their careers. UNEMPloyment is just insignificant at a P- 
value of .@5, which may indicate that the civilian 
positions this group are seeking are not related to the 
national unemployment rate. 

C. Performance Index Interval Table 

Figure 4.12 shows the interval table with the 
corresponding attrition percentages. With this data group, 
the performance INDEX does a complete reversal from the 
previous data groups. In the previous populations, 
attrition was highest among the intervals representing the 
lowest index scores. A percentile breakdown of the 
performance INDEX scores of this data group reveals that 
those officers with the highest scores attrit at the 


greatest rate. Interval l, or those officers with a score 
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Figure 4.12 


Colonels (Ground) 


Lleutenant 


0 


less than or equal to .838258, have an "in" percentage of 33 
percent and an "out" percentage of 16.9. On the other hand, 
interval 109 has an "out" rate of 52 percent and an "in" rate 
of 47.6 percent. A review of this table clearly shows that 
those officers in the higher interval subgroupings  attrited 
at the greatest rate. This would indicate the Marine Corps 
is losing those officers with the higher performance INDEX 
scores from this data group. 
7. Lieutenant Colonel (Air) 
a. Prediction Rates 

The application of LOGIST to this population 
group produced mixed results for FY81 and  FY82. The 
prediction rate for FY81 was 93 percent, with  LOGIST 
forecasting 14 officers against an actual attrition of 13 
officers. For ٧۷82, LOGIST predicted 13 officers would 
leave the Marine Corps when actually 16 officers resigned 
their commissions. This resulted in a predictability rate 
of only 81 percent for FY82. Figure 4.13 displays the 
LOGIST output for this data group. 

b. Significance of Variables 

INDEX was the only variable that remained in 
this model. The input variables for this model were similar 
to those used to analyze the lieutenant colonel (Ground) 
population group with the exception of MOS. MOS was not 
used with this group because, like the other groups 


involving pilots, they had been arranged by MOS initially. 
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The variables evaluated in this model are shown below in 


Table XI. 

INDEX again emerges as the primary variable for 
determining attrition for this group and, like the 
lleutenant colonel (Ground) population group, the 
coefficient is positive. The other variables analyzed by 


the model were deleted for the same reasons given during the 
discussion of the previous data group. Figure 4.14 shows 
TABLE XI 


VARIABLE SIGNIFICANCE, LIEUTENANT COLONELS (AIR) 


Variable P - Value Chi - Square 
INDEX 0.0001 14793 
UNEMP 0.4113 0.67 
PAY 0.6854 0.16 
EDSPES 079985 0.00 


-— سے سے سے سسس سسس جس سے‎ “hYI I “m. v “x gra n 
-—— ہے‎ m “m a m mm r حمست سے ست سے ست‎ 
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the final parameter estimates of this data group along with 
pertinent statistics on the variables deleted from the 
model. 
c. Performance Index Interval Table 

Figure 4.15 shows the table for this population 
group with attrition and retention percentages by interval. 
Although the total number of officers appearing in this 
table is much less than the lieutenant colonel ground table, 


239 versus 648, the results are similar. Interval 1, 
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a‏ ہے t s Q Ds Q Q  —‏ “< سه ټس 


LT COLS IAIR) WITH 20 YEARS 


STEPWISE LOGISTIC REGRESSION PROCEDUR E 


DEPENDENT VARIABLE: QUT ۱ 
239 CBSERVATIONS | 
188 QUI = 
51 UUT = | 
62 OBSLRVATIUNS DELETŁU DUE TU MISSING VALUES | 
VARIASLE MEAN MINIMUM MAXIMUM RANGE | 
INDXN 0.891455 0.796498 0.970497 0.173439 | 
PAY -5.62703 -7+3 -4.5 2ed 
UNEMP 0.02 74142 0.0245 0.031 0.0065 | 
EDSPEC 1.27615 I 2 l | 
-2 LO; LIKELIHUUD FU4 MUDEL CONTAINING INTERCEPT ONLYs 247.30 | 
STEP O. THE FCLLONING VARIABLES ARE ENTEREU: | 
INTERCEP 1 PAY UNEMP EDSPEC | 
MODEL SHI-SWUARE= 16.94 WITH %*% Defoe (SCIRE STAT.) Ps0.0020. 
CONVERSENLE UBTAINED IN 5 ITERATIONS. R= 9.197. | 
MAX ABSCLUTE DERIVATIVE=0.03 200-07, -2 LOG L= 230.17. 
MUDEL :HI-SQUAREs 17.03 Wl TH — 4 D.F. ۱-2 6 ۲۰۸۰ 057 | 
FRACTION UF CINCOROANT PAIRS UF PREDICTED PRUSABILITIES AND RESPUNSES 20.681 
RANK CURRELATIGN BETWEEN PREDICTED PRUBASILITY AND RESPONSE 29.382 | 
FAST BACKWARD ELIMINATIUN | 
v AR LAU LE RESIDJAL 
DELETE U CHI-SQUARE P CHI-S JU ARC D.F. P | 
٢٤٢۴ 0.00 0.9985 0.00 l 0.9935 | 
UNEMP 0.67 0.4113 0.67 2 2.1135 
PAY 0.16 0. 6354 0.84 3 0.3401 | 
SEP l- | 
MODEL IMI-SQUARE= _ 16.03 WITH ۱ 0۰۴۰ (SCURE STAT.) P=0.0001. | 
CONVERGENCE ULTAINEO IN 5 ITERATIUNS. = 0,244, 
MAX AD3CLUTE VERIVATIVE=0.92 800-03. -2 LOG L= 231,00. | 
MUDEL ¿hI-SQUARE= 1lo.81 WITH 1 D.F, (-2 LDG L.R.) P=0.;0000. | 
FRACTION CF CONCORJANT PAI«5 UF PREVICTED PKUDASILITILS ANO RESPUNSES : 0 ۰ 6 6 | 
RANK CURRELATLON BETWEEN PREDICTED PRUDADILITY AND RESPUNSE 20.391 | 
TEST FUR ALL VARIABLES NUT IN THE ۱۸ | 
RESIDUAL CHI-SUUAR E= 0.84 WITH 3 D.F. 2 
RES IVUAL CHI-3>QUARE IS NOT SIGNIFICANT AT THE 0.9590 LCVEL. | 
LT CULS (AIR) WITH 20 YEARS | 
STEPMISE LOGISTIC REGRESSION PRUCCUURE | 
DEPENDENT VARIABLE: UUT | 
FINAL PARAMETER ESTIMATES | 
VARIAOLE BETA STO. ERROR CHI-SQUARE P F. | 
INTERCEPT -20.5006346I6 5.001 25297 15.30 9.0200 | | 
IND XN 21.31822017 5.53319721 14.93 IO U2 | 
Figure 4.14 Lieutenant Colonels (Air) 
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officers with a performance index score less than or equal 
to .847943, Shows retention at 91 percent and attrition at 
8.7 percent. Intervals 9 and 10, or those officers with the 
highest performance index, Show attrition rates of 56 and 41 
percent respectively. Again, contrary to the earlier groups 
analyzed, this population group shows that officers with the 
highest performance indexes are attriting at the greatest 
rate. 
8. Colonels (All) 
a. Prediction Rates 

With this last data group, there were no 
variables which passed the significance test. Table XII 
shows the P-value and Chi-Square statistics of the variables 
deleted from this model. Because these variables did not 
enter the model, LOGIST assigned the entire population group 
a uniform probability of leaving the service. This was due 
in large part to the relatively small size of the population 
group. The results of this procedure were discarded because 
they merely equated to a random chance probability of 
attrition. Accordingly, further analysis of the variables 
and prediction rates was not conducted for this group. 

b. Performance Index Interval Table 

The colonels displayed similar results when 
compared with the lieutenant colonel's ground and air data 
groups. Attrition is greatest at the highest performance 


INDEX interval. That interval, interval lO0, shows an 
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TABLE XII 


VARIABLE SIGNIFICANCE, COLONELS (ALL) 


Variable P - Value Chi - Square 
INDEX 0.2001 1.64 
UNEMP 0.4870 0.48 
EDSPEC 0.5257 0.40 


| 
| 
| 
| 
| 
| 
| 
| PAY 0.0855 2.96 
| 
| 
| 
| 
| 
| 
| 


attrition rate of 48 percent for those officers with a score 
greater than or equal to .933774. The remaining intervals 
show a substantial decrease in their attrition rates when 
compared with interval l€. Figure 4.16 shows the results of 


the interval tables by performance INDEX. 


F. SUMMARY 


This concludes the data analysis phase of the  authors' 
study of Marine officer attrition. In the following 
chapter, these results will be consolidated for clarity and 
the authors will provide comments and recommendations’ for 


future studies in this area. 
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V. SUMMARY 


A. GENERAL 

This chapter will consolidate the results of the output 
discussed in the previous chapter and offer some comments 
and recommendations regarding further research in the area 
of predicting Marine officer attrition. Figure 5.1 depicts, 
by data group, the prediction sums developed by the SAS 
LOGIST function along with actual attrition for FY81 and 
FY82. These figures were transformed into a prediction rate 
which is also included in Figure 1 » Additionally, 
variables which were retained in the model are listed in 
order of significance while those deleted are presented in a 


similiar format. 


B. PREDICTION RATES 


The overall results of this binary choice model, using 
the SAS LOGIST procedure, were not encouraging. For FY81, 
three of the five data groups analyzed gave a prediction 
rate over 90 percent. At first glance, an ability to 
predict attrition of Marine Officers at a 90 percent or 
better rate would seem to validate the models and thus 
provide a useful tool for manpower planning. But, in all 
three cases, when these same population groups were used to 
forecast FY82 attrition, the prediction rates dropped well 


below the 90 percent benchmark achieved for the FY8l data. 
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Additionally, the rates obtained for the remaining data 
groups were far below the 90 percent level for both FY81 and 
ء۲‎ 2 Since the results of the tests conducted varied from 
highly successful to totally unacceptable, the loa rt 
procedure would appear to contain sufficient inaccuracy to 
preclude its use. 

This analysis however, has provided further insight into 
the difficult question of predicting officer attrition. 
This problem is very difficult to solve uSing Statistical 
models. Surely, there are a number of variables which 
cannot be easily quantified yet play a major role in an 
officer's decision to leave the service. Some of those 
Variables, such as family Situation, next duty assignment, 
personal contacts in the civilian job market and self 
perception, would have to be individually modeled for this 
type of analysis to prove statistically relevant to the 
user. Through personal experiences, the authors have 
consistently heard the above reasons given as to why an 
officer has chosen to leave the service. This study seems 
to confirm the diverse nature of this decision. 

Future studies in this area should concentrate on 
evaluating more population groups with additional variables 
over a longer period of time to provide a wider range for 
analysis. Only in this manner can the investigator nhope to 
achieve relevant results for this problem through the use of 


standard statistical techniques. 
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C. SIGNIFICANCE OF VARIABLES 


As shown in Figure 5.1, INDEX was the most Significant 
variable in each of the five population groups analyzed. 
These results confirmed the perceptions provided Dy MONDE 
Esmann during his initial research. Officers interviewed 
for that study felt that promotion potential was a major 
factor when determining whether to remain on active duty or 
leave the service. Further, they felt that a high promotion 
potential would indicate satisfaction with the service while 
a low promotion potential would cause an officer to resign 
his commision [Ref. 9]. While the performance INDEX proved 
Significant with all of the population groups, it is of 
particular note that for the three most senior groups 
analyzed (lieutenant colonels, Air and Ground, and 
colonels), the variable had a positive coefficient. The 
inverse relationship of this positive coefficient means that 
as an individual's INDEX score increases at these higher 
ranks, so does the probability that he will leave the Marine 
Corps. Additionally there is the question of whether the 
performance INDEX equates to promotion potential. One major 
shortcoming of this variable in relation to promotion 
potential was that it failed to reflect an officer's level 
of experience or his past job assignments. The assignment 
variable in particular is one of the most significant 


factors considered by promotion boards and is continually 
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stressed throughout the Marine Corps as a vital ingredient 
when planning the "ideal" career. In essence, those Marine 
officers who have been assigned the "better jobs", may in 
fact have lower INDEX scores because of the competitive 
nature of those billets. Nevertheless, these officers will 
still have a greater promotion potential than their 
contemporaries who received a nigher INDEX Score from a less 
career-enhancing billet. Since the INDEX score has such a 
narrow range, job assignment may in fact be the vital 
ingredient for determining promotion potential. A review of 
the GAO study on quality retention of Marine officers shows 
that a job assignment fator was numerically transformed and 
combined with a performance indicator in order to provide a 
more realistic presentation of promotion potential  [Ref. 
ID]. Future studies in this area should include a job 
assignment factor to weight the performance INDEX when 
evaluating the effect of promotion potential on attrition. 
While the Esmann study concluded that the unemployment 
variable (UNEMP) was significant in predicting attrition, the 
SAS LOGIST procedure provided quite the opposite results. 
In three of the five data groups analyzed, the unemployment 
variable did not meet the .05 significance level and was 
deleted from the model. In those cases where it remained, 
the population groups were completing their initial 
contracts and reviewing their employment opportunities in 


the civilian community. These groups, first lieutenant 
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(Ground) and captain (Air), were facing similiar decisions 
and the unemployment rate appears to have been an important 
factor in their decision to leave the Marine Corps. For the 
remaining three data groups, the effects of the employment 
Situation were of little or no Significance. 

During the initial phases of this study it was felt that 
the educational specialty  (EDSPEC) variable would be 
Significant only to the more junior population groups whose 
recently acquired skills remained a marketabl» asset. This 
assumption proved correct, with the first lieutenant 
through captain data groups retaining  EDSPEC and the 
lieutenant colonel data groups deleting this variable. This 
would seem to indicate that a college major is more 
important to a young officer entering the civilian market 
and less important to the career officer who must sell his 
managerial background rather than what he studied in college 
twenty years ago. 

The MOS variable was input as a independent variable in 


only three of the five population groups analyzed. Of those 


three groups, it was retained by only two as being 
significant, first lieutenants and lieutenant colonels 
(Ground), The retention of this variable and its degree of 


significance in the lieutenant colonels (Ground) model 
should be noted. It may be that MOS is directly correlated 
to the job assignment factor previously discussed. It would 


appear that those officers with combat arms MOS's (0302 and 
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0802) are in a better position to serve in those assignments 
considered career enhancing while those officers without 
these MOS's would not have the opportunity to assume the 
limited number of command billets. While an individual's 
past assignments were not introduced into this study, the 
presence of MOS in this particular model may indicate its 
relationship with promotion potential and therefore 
attrition. 

The last independent variable to be included in this 
study was pay comparibility with the civilian sector. For 
the most part this variable proved insignificant, being 
retained in only two of the eight data groups analyzed. 
However, in the case of the captain (Air), PAY was second to 
INDEX in its level of significance to the model. Although 
not a principle factor in this population group's decision 
to leave the Marine Corps, the appearance of PAY in the 
captain (Air) model still suggests that money is important 
to this group and may explain the payment of bonuses to 
retain the younger naval aviator. 


To summarize, the viability of the performance INDEX 


score as a predictor of promotion potential was not 
determined during this study. However, its value in 
predicting attrition was confirmed. The same can not be 


Stated of the other independent variables which nevertheless 
provided some interesting insights into the various elements 


affecting an officer's decision to leave the Marine Corps. 
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D. PERFORMANCE INDEX INTERVALS 


The performance index interval tables were originally 
constructed to assist the authors in determining at what 
INDEX level the greatest attrition was occuring for each 
population group. Using this information in conjunction 
with the SAS LOGIST output, the authors would be able to 
ascertain at which intervals SAS was having the most success 
in predicting attrition. From the results provided, the 
indication is that LOGIST predicts quite well at the extreme 
ends of the tables while the prediction capabilities in the 
middle intervals are far less accurate. 

Through this process the authors discovered that the 
senior officers, lieutenant colonels - year 20, and colonels 
- year 26, with the highest performance index scores were 
attriting at the greatest rate. Table XII shows the 
retention and attrition percentages at the interval 
extremes for each of the population groups analyzed. AS 
this table indicates, the percentage of officers staying in 
or leaving the Marine Corps compared to their performance 
index interval is completely reversed between the junior and 
Senior officers. If a high performance index equates to 
being a good officer, then the significance of tnis 
information would be that the Marine Corps is losing its 
best officers when they reach the Senior ranks. Of course, 


as discussed previously, tne performance index may not 
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TABLE XIII 


CONSOLIDATED PERFORMANCE INDEX INTERVALS 


| | 
| | 
| | 
| | 
۱ | 
| Population Index Percentage | 
| Group Interval Value In Out | 
| | 
| 1st Lt (GND) 1 C0007 47% 52% | 
| 10 2.955157 85% 14% | 
| | 
| Capt's (GND) 1 <. 843051 83% 16% | 
| 10 2.950598 89% 10% | 
| | 
| Capt's (AIR) 1 <.840127 59% 40% | 
| 10 >.944003 91% 8% | 
| | 
| Lt Col's (GND) 1 C8258 83% 16% | 
| 10 >. 929695 47% 52% | 
| | 
| Lt Col's (AIR) 1 <.847943 91% 8% | 
| 12 >.932495 58% 41% | 
| | 
| Col's (ALL) 1 3ء‎ 5 77% 22% | 
| 10 25.933774 51% 48% | 
| | 


indicate the total professional ability of Marine Corps 
senior officers because it fails to consider past 
assignments when evaluating a Marine's worth to the service. 
Nevertheless, an officer with twenty years of service has 
had a variety of assignments with different reporting 
seniors. If he has been able to maintain an above average 
performance index score throughout that period, it Should be 
a true indicator of his greater ability and increased 
promotion potential. 

The GAO report used a job experience factor along with a 


performance indicator which showed that the Marine Corps was 
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retaining its better senior officers. The opposing results 
achieved by this study and the GAO report indicates that 
different methods of evaluating promotion potential will 
yield varying results. Any future studies in this area 
should begin by identifying the value of the performance 
index to determine if it is a true indicator of an officer's 


performance and, therefore, promotion potential. 


E. CONCLUSION 


The overall success rate of the logit function to pre- 
dict Marine officer attrition was less than the authors had 
expected. A possible explanation may lie with the variables 
selected to describe the individuals in the population 
groups. The performance INDEX score is clearly a Starting 
point for determining the promotion potential of an officer, 
but his past assignments cannot be overlooked as a signifi- 
cant factor in this regard. while the remaining variables 
provide some interesting insights into the differences  be- 
tween the population groups, their usefulness in predicting 
attrition was generally minimal. In retrospect, the 
complexity of this decision, to remain on active duty or 
leave the Corps, may make it impossible to accurately model 
using currently available data. Only with the inclusion of 
a number of additional, difficult to obtain or measure 
variables, can an analyst hope to achieve accurate results 


across all population groups and years of service. 
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